Generalized Sparse Convolutional Neural Networks for Semantic Segmentation of Point Clouds Derived from Tri-Stereo Satellite Imagery

We studied the applicability of point clouds derived from tri-stereo satellite imagery for semantic segmentation for generalized sparse convolutional neural networks by the example of an Austrian study area. We examined, in particular, if the distorted geometric information, in addition to color, influences the performance of segmenting clutter, roads, buildings, trees, and vehicles. In this regard, we trained a fully convolutional neural network that uses generalized sparse convolution one time solely on 3D geometric information (i.e., 3D point cloud derived by dense image matching), and twice on 3D geometric as well as color information. In the first experiment, we did not use class weights, whereas in the second we did. We compared the results with a fully convolutional neural network that was trained on a 2D orthophoto, and a decision tree that was once trained on hand-crafted 3D geometric features, and once trained on hand-crafted 3D geometric as well as color features. The decision tree using hand-crafted features has been successfully applied to aerial laser scanning data in the literature. Hence, we compared our main interest of study, a representation learning technique, with another representation learning technique, and a non-representation learning technique. Our study area is located in Waldviertel, a region in Lower Austria. The territory is a hilly region covered mainly by forests, agriculture, and grasslands. Our classes of interest are heavily unbalanced. However, we did not use any data augmentation techniques to counter overfitting. For our study area, we reported that geometric and color information only improves the performance of the Generalized Sparse Convolutional Neural Network (GSCNN) on the dominant class, which leads to a higher overall performance in our case. We also found that training the network with median class weighting partially reverts the effects of adding color. The network also started to learn the classes with lower occurrences. The fully convolutional neural network that was trained on the 2D orthophoto generally outperforms the other two with a kappa score of over 90% and an average per class accuracy of 61%. However, the decision tree trained on colors and hand-crafted geometric features has a 2% higher accuracy for roads

Recent Deforestation Pattern Changes (2000-2017) in the Central Carpathians:A Gray-Level Co-Occurrence Matrix and Fractal Analysis Approach

The paper explores the distribution of tree cover and deforested areas in the Central Carpathians in the central-east part of Romania, in the context of the anthropogenic forest disturbances and sustainable forest management. The study aims to evaluate the spatiotemporal changes in deforested areas due to human pressure in the Carpathian Mountains, a sensitive biodiverse European ecosystem. We used an analysis of satellite imagery with Landsat-7 Enhanced Thematic Mapper Plus (Landsat-7 ETM+) from the University of Maryland (UMD) Global Forest Change (GFC) dataset. The workflow started with the determination of tree cover and deforested areas from 2000–2017, with an overall accuracy of 97%. For the monitoring of forest dynamics, a Gray-Level Co-occurrence Matrix analysis (Entropy) and fractal analysis (Fractal Fragmentation-Compaction Index and Tug-of-War Lacunarity) were utilized. The increased fragmentation of tree cover (annually 2000–2017) was demonstrated by the highest values of the Fractal Fragmentation-Compaction Index, a measure of the degree of disorder (Entropy) and heterogeneity (Lacunarity). The principal outcome of the research reveals the dynamics of disturbance of tree cover and deforested areas expressed by the textural and fractal analysis. The results obtained can be used in the future development and adaptation of forestry management policies to ensure sustainable management of exploited forest areas

Improvement of VHR Satellite Image Geometry with High Resolution Elevation Models

The number of high and very high resolution (VHR) optical satellite sensors, as well as the number of medium resolution satellites is continuously growing. However, not all high-resolution optical satellite imaging cameras have a sufficient and stable calibration in time. Due to their high agility in rotation, a quick change in viewing direction can lead to satellite attitude oscillation, causing image distortions and thus affecting image geometry and geo-positioning accuracy. This paper presents an approach based on re-projection of regularly distributed 3D ground points from object in image space, to detect and estimate the periodic distortions of Pléiades tri-stereo imagery caused by satellite attitude oscillations. For this, a hilly region was selected as a test site. Consequently, we describe a complete processing pipeline for computing the systematic height errors (deformations, waves) of the satellite-based digital elevation model by using a Lidar high resolution terrain model. Ground points with fixed positions, but with two elevations (actual and corrected) are then re-projected to the satellite images with the aid of the Rational Polynomial Coefficients (RPCs) provided with the imagery. Therefore, image corrections (displacements) are determined by computing the differences between the distinct positions of corresponding points in image space. Our experimental results in Allentsteig (Lower Austria) show that the systematic height errors of satellite-based elevation models cannot be compensated with an usual or even high number of Ground Control Points (GCPs) for RPC bias correction, due to insufficiently known image orientations. In comparison to a reference Lidar Digital Terrain Model (DTM), the computed elevation models show undulation effects with a maximum height difference of 0.88 m in along-track direction. With the proposed method, image distortions in-track direction with amplitudes of less than 0.15 pixels were detected. After applying the periodic distortion compensation to all three images, the systematic elevation discrepancies from the derived elevation models were successfully removed and the overall accuracy in open areas improved by 33% in the RMSE. Additionally, we show that a coarser resolution reference elevation model (AW3D30) is not feasible for improving the geometry of the Pléiades tri-stereo satellite imagery

3D Calibration Test-Field for Digital Cameras Mounted on Unmanned Aerial Systems (UAS)

Due to the large number of technological developments in recent years, UAS systems are now used for monitoring purposes and in projects with high precision demand, such as 3D model-based creation of dams, reservoirs, historical monuments etc. These unmanned systems are usually equipped with an automatic pilot device and a digital camera (photo/video, multispectral, Near Infrared etc.), of which the lens has distortions; but this can be determined in a calibration process. Currently, a method of “self-calibration„ is used for the calibration of the digital cameras mounted on UASs, but, by using the method of calibration based on a 3D calibration object, the accuracy is improved in comparison with other methods. Thus, this paper has the objective of establishing a 3D calibration field for the digital cameras mounted on UASs in terms of accuracy and robustness, being the largest reported publication to date. In order to test the proposed calibration field, a digital camera mounted on a low-cost UAS was calibrated at three different heights: 23 m, 28 m, and 35 m, using two configurations for image acquisition. Then, a comparison was made between the residuals obtained for a number of 100 Check Points (CPs) using self-calibration and test-field calibration, while the number of Ground Control Points (GCPs) variedand the heights were interchanged. Additionally, the parameters where tested on an oblique flight done 2 years before calibration, in manual mode at a medium altitude of 28 m height. For all tests done in the case of the double grid nadiral flight, the parameters calculated with the proposed 3D field improved the results by more than 50% when using the optimum and a large number of GCPs, and in all analyzed cases with 75% to 95% when using a minimum of 3 GCP. In this context, it is necessary to conduct accurate calibration in order to increase the accuracy of the UAS projects, and also to reduce field measurements

Improvement of VHR Satellite Image Geometry with High Resolution Elevation Models

The number of high and very high resolution (VHR) optical satellite sensors, as well as the number of medium resolution satellites is continuously growing. However, not all high-resolution optical satellite imaging cameras have a sufficient and stable calibration in time. Due to their high agility in rotation, a quick change in viewing direction can lead to satellite attitude oscillation, causing image distortions and thus affecting image geometry and geo-positioning accuracy. This paper presents an approach based on re-projection of regularly distributed 3D ground points from object in image space, to detect and estimate the periodic distortions of Pléiades tri-stereo imagery caused by satellite attitude oscillations. For this, a hilly region was selected as a test site. Consequently, we describe a complete processing pipeline for computing the systematic height errors (deformations, waves) of the satellite-based digital elevation model by using a Lidar high resolution terrain model. Ground points with fixed positions, but with two elevations (actual and corrected) are then re-projected to the satellite images with the aid of the Rational Polynomial Coefficients (RPCs) provided with the imagery. Therefore, image corrections (displacements) are determined by computing the differences between the distinct positions of corresponding points in image space. Our experimental results in Allentsteig (Lower Austria) show that the systematic height errors of satellite-based elevation models cannot be compensated with an usual or even high number of Ground Control Points (GCPs) for RPC bias correction, due to insufficiently known image orientations. In comparison to a reference Lidar Digital Terrain Model (DTM), the computed elevation models show undulation effects with a maximum height difference of 0.88 m in along-track direction. With the proposed method, image distortions in-track direction with amplitudes of less than 0.15 pixels were detected. After applying the periodic distortion compensation to all three images, the systematic elevation discrepancies from the derived elevation models were successfully removed and the overall accuracy in open areas improved by 33% in the RMSE. Additionally, we show that a coarser resolution reference elevation model (AW3D30) is not feasible for improving the geometry of the Pléiades tri-stereo satellite imagery

The role of tourism in local economy development. Bihor County case study

The purpose of the present study is to emphasize the role of tourism in local economy development, in the context of present-day society dominated by antagonistic battles between local/regional values and the global ones. Tourism is a special anthropic activity, with deep implications both in the spatial individuality and regional values assertion and in those with global character. It sets up for a significant indicator regarding the development level recorded by a human collectivity in a certain area. In this context, the results of the correlations between the number of companies, employees, turnover and recorded profit, during the period between 2000 and 2014, on spatial and global level, become significant indicators, having special relevance in the role and importance of tourism in local economy development

Proposed Methodology for Accuracy Improvement of LOD1 3D Building Models Created Based on Stereo Pléiades Satellite Imagery

Three-dimensional city models play an important role for a large number of applications in urban environments, and thus it is of high interest to create them automatically, accurately and in a cost-effective manner. This paper presents a new methodology for point cloud accuracy improvement to generate terrain topographic models and 3D building modeling with the Open Geospatial Consortium (OGC) CityGML standard, level of detail 1 (LOD1), using very high-resolution (VHR) satellite images. In that context, a number of steps are given attention (which are often (in the literature) not considered in detail), including the local geoid and the role of the digital terrain model (DTM) in the dense image matching process. The quality of the resulting models is analyzed thoroughly. For this objective, two stereo Pléiades 1 satellite images over Iasi city were acquired in September 2016, and 142 points were measured in situ by global navigation satellite system real-time kinematic positioning (GNSS-RTK) technology. First, the quasigeoid surface resulting from EGG2008 regional gravimetric model was corrected based on data from GNSS and leveling measurements using a four-parameter transformation, and the ellipsoidal heights of the 142 GNSS-RTK points were corrected based on the local quasigeoid surface. The DTM of the study area was created based on low-resolution airborne laser scanner (LR ALS) point clouds that have been filtered using the robust filter algorithm and a mask for buildings, and the ellipsoidal heights were also corrected with the local quasigeoid surface, resulting in a standard deviation of 37.3 cm for 50 levelling points and 28.1 cm for the 142 GNSS-RTK points. For the point cloud generation, two scenarios were considered: (1) no DTM and ground control points (GCPs) with uncorrected ellipsoidal heights resulting in an RMS difference (Z) for the 64 GCPs and 78 ChPs of 69.8 cm and (2) with LR ALS-DTM and GCPs with corrected ellipsoidal height values resulting in an RMS difference (Z) of 60.9 cm. The LOD1 models of 1550 buildings from the Iasi city center were created based on Pléiades-DSM point clouds (corrected and not corrected) and existing building sub-footprints, with four methods for the derivation of the building roof elevations, resulting in a standard deviation of 1.6 m against high-resolution (HR) ALS point cloud in the case of the best scenario. The proposed method for height extraction and reconstruction of the city structure performed the best compared with other studies on multiple satellite stereo imagery

Proposed Methodology for Accuracy Improvement of LOD1 3D Building Models Created Based on Stereo Pléiades Satellite Imagery

Three-dimensional city models play an important role for a large number of applications in urban environments, and thus it is of high interest to create them automatically, accurately and in a cost-effective manner. This paper presents a new methodology for point cloud accuracy improvement to generate terrain topographic models and 3D building modeling with the Open Geospatial Consortium (OGC) CityGML standard, level of detail 1 (LOD1), using very high-resolution (VHR) satellite images. In that context, a number of steps are given attention (which are often (in the literature) not considered in detail), including the local geoid and the role of the digital terrain model (DTM) in the dense image matching process. The quality of the resulting models is analyzed thoroughly. For this objective, two stereo Pléiades 1 satellite images over Iasi city were acquired in September 2016, and 142 points were measured in situ by global navigation satellite system real-time kinematic positioning (GNSS-RTK) technology. First, the quasigeoid surface resulting from EGG2008 regional gravimetric model was corrected based on data from GNSS and leveling measurements using a four-parameter transformation, and the ellipsoidal heights of the 142 GNSS-RTK points were corrected based on the local quasigeoid surface. The DTM of the study area was created based on low-resolution airborne laser scanner (LR ALS) point clouds that have been filtered using the robust filter algorithm and a mask for buildings, and the ellipsoidal heights were also corrected with the local quasigeoid surface, resulting in a standard deviation of 37.3 cm for 50 levelling points and 28.1 cm for the 142 GNSS-RTK points. For the point cloud generation, two scenarios were considered: (1) no DTM and ground control points (GCPs) with uncorrected ellipsoidal heights resulting in an RMS difference (Z) for the 64 GCPs and 78 ChPs of 69.8 cm and (2) with LR ALS-DTM and GCPs with corrected ellipsoidal height values resulting in an RMS difference (Z) of 60.9 cm. The LOD1 models of 1550 buildings from the Iasi city center were created based on Pléiades-DSM point clouds (corrected and not corrected) and existing building sub-footprints, with four methods for the derivation of the building roof elevations, resulting in a standard deviation of 1.6 m against high-resolution (HR) ALS point cloud in the case of the best scenario. The proposed method for height extraction and reconstruction of the city structure performed the best compared with other studies on multiple satellite stereo imagery